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Abstract. This paper investigates the existence of inseparable disjoint pairs of NP lan- 
guages and related strong hypotheses in computational complexity. Our main theorem 
says that, if NP does not have measure in EXP, then there exist disjoint pairs of NP 
languages that are P-inseparable, in fact TIME(2(n k))-inseparable. We also relate these 
conditions to strong hypotheses concerning randomness and genericity of disjoint pairs. 



1. Introduction 

The main objective of complexity theory is to assess the intrinsic difficulties of naturally 
arising computational problems. It is often the case that a problem of interest can be 
formulated as a decision problem, or else associated with a decision problem of the same 
complexity, so much of complexity theory is focused on decision problems. Nevertheless, 
other types of problems also require investigation. 

This paper concerns promise problems, a natural generalization of decision problems 
introduced by Even, Selman, and Yacobi [7]. A decision problem can be formulated as a 
set A C {0,1}*, where a solution of this problem is an algorithm, circuit, or other device 
that decides A, i.e., tells whether or not an arbitrary input x E {0, 1}* is an element 
of A. In contrast, a promise problem is formulated as an ordered pair {A,B) of disjoint 
sets A,BC1 {0, 1}*, where a solution is an algorithm or other device that decides any set 
•S" ^ {0, 1}* such that ACS and i? n 5 = 0. Such a set S is called a separator of the 
disjoint pair {A,B). Intuitively, if we are promised that every input will be an element of 
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AU B, then a separator of {A, B) enables us to distinguish inputs in A from inputs in B. 
Since each decision problem A is clearly equivalent to the promise problem {A,A'^'), where 
A'^ = {0, 1}* — ^ is the complement of A, promise problems are, indeed, a generalization of 
decision problems. 

A disjoint NP pair is a promise problem {A, B) in which A,B& NP. Disjoint NP pairs 
were first investigated by Selman and others in connection with public key cryptosystems 
[7, 15, 26, 17]. They were later investigated by Razborov [25] as a setting in which to prove 
the independence of complexity-theoretic conjectures from theories of bounded arithmetic. 
In this same paper, Razborov established a fundamental connection between disjoint NP 
pairs and propositional proof systems. Propositional proof systems had been used by Cook 
and Reckhow [6] to characterize the NP versus co-NP problem. Razborov [25] showed that 
each propositional proof system has associated with it a canonical disjoint NP pair and that 
important questions about propositional proof systems are thereby closely related to natural 
questions about disjoint NP pairs. This connection with propositional proof systems has 
motivated more recent work on disjoint NP pairs by Glai3er, Selman, Sengupta, and Zhang 
[10, 9, 12, 13]. It is now known that the degree structure of propositional proof systems 
under the natural notion of proof simulation is identical to the degree structure of disjoint 
NP pairs under reducibility of separators [12]. Much of this recent work is surveyed in [11]. 
Goldreich [14] gives a recent survey of promise problems in general. 

Our specific interest in this paper is the existence of disjoint NP pairs that are P- 

k 

inseparable, or even TIME(2"' )-inseparable. As the terminology suggests, if C is a class 
of decision problems, then a disjoint pair is C-inseparable if it has no separator in C. The 
existence of P-inseparable disjoint NP pairs is a strong hypothesis in the sense that (1) it 
clearly implies P ^ NP, and (2) the converse implication is not known (and fails relative to 
some oracles [17]). It is clear that P ^ NP n coNP implies the existence of P-inseparable 
disjoint NP pairs, and Grollmann and Selman [15] proved that P 7^ UP also implies the 
existence of P-inseparable disjoint NP pairs. 

The hypothesis that NP is a non-measure subset of EXP, written //(NP | EXP) 7^ 0, 
is a strong hypothesis in the above sense. This hypothesis has been shown to have many 
consequences not known to follow from more traditional hypotheses such as P 7^ NP or 
the separation of the polynomial-time hierarchy into infinitely many levels. Each of these 
known consequences has resolved some pre-existing complexity-theoretic question in the 
way that agreed with the conjecture of most experts. This explanatory power of the /i(NP | 
EXP) 7^ hypothesis is discussed in the early survey papers [23, 2, 24] and is further 
substantiated by more recent papers listed at [16] (and too numerous to discuss here). In 
several instances, the discovery that //(NP j EXP) 7^ implies some plausible conclusion has 
led to subsequent work deriving the same conclusion from some weaker hypothesis, thereby 
further illuminating the relationships among strong hypotheses. 

Our main theorem states that, if NP does not have measure zero in EXP, then, for 

k 

every positive integer k, there exist disjoint NP pairs that are TIME(2" )-inseparable. Such 

pairs are a fortiori P-inseparable, but the conclusion of our main theorem actually gives 
exponential lower bounds on the inseparability of some disjoint NP pairs. These are the 
lower bounds that most experts conjecture to be true, even though an unconditional proof 
of such bounds may be long in coming. 

The proof of our main theorem combines known closure properties of NP with the 
randomness that the /t(NP | EXP) 7^ hypothesis implies must be present in NP to give an 

k 

explicit construction of a disjoint NP pair that is TIME(2" )-inseparable. (Technically, this 
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is an overstatement. The last step of the "construction" is the removal of a finite set whose 
existence we prove, but which we do not construct.) The details are perhaps involved, but 
we preface the proof with an intuitive motivation for the approach. 

We also investigate the relationships between the two strong hypotheses in our main 
theorem (i.e., its hypothesis and its conclusion) and strong hypotheses involving the exis- 
tence of disjoint NP pairs with randomness and genericity properties. Roughly speaking 
(i.e., omitting quantitative parameters), we show that the existence of disjoint NP pairs 
that are random implies both the /x(NP | EXP) ^ hypothesis and the existence of disjoint 
NP pairs that are generic in the sense of Ambos-Spies, Fleischhack, and Huwig [1]. We also 
show that the existence of such generic pairs implies the existence of disjoint NP pairs that 

k 

are TIME(2" )-inseparable. Taken together, these results give the four implications at the 
top of Figure 1. (The four implications at the bottom are well known.) We prove that three 
of these implications cannot be reversed by relativizable techniques, and we conjecture that 
this also holds for the remaining implication. 



2. Preliminaries 

We write N for the set of nonnegative integers and Z+ for the set of (strictly) positive 
integers. The Boolean value of an assertion (f) is [<^] = if (f) then 1 else 0. All logarithms 
here are base-2. 

We write A for the empty string, \w\ for the length of a string w, and sq, si,S2, ■ ■ ■ for 
the standard enumeration of {0, 1}*. The index of a string x is the value ind(x) G N such 
that Sind(a;) = X- We write next(x) for the string following x in the standard enumeration, 
i.e., next(s„) = Sn+i- More generally, for fc G N, we write next'^ for the A;-fold composition 
of next with itself, so that next^(s„) = s^+k- 

A Boolean function is a function / : {0, 1}"* {0, 1} for some m G N. The support of 

such a function / is supp(/) = |x G {0, 1}"* f{x) = l|. 

We write w[i] for the i*^ symbol in a string w and for the string consisting of the 

^th ti^rough j^^ symbols. The leftmost symbol of w is w[0], so that w = w[0..\w\ — 1]. For 
(infinite) sequences S G the notations S[i] and S[i..j] are defined similarly. A string 
■u; G S* is a prefix of a string or sequence a; G S* U S°°, and we write w ^ x, if there is 
a string or sequence y G S* U such that wy = x. A language, or decision problem, is 
a set A C {0, 1}*. We identify each language A with the sequence A G {0, 1}°° defined by 
A[n] = {sn G A} for all n G N. If A is a language, then expressions like limyj^Af{w) refer 
to prefixes w ^ A, e.g., lim^^A/(^'^) = lim„_^oo fiA[0..n - 1]). 

A martingale is a function d : {0, 1}* — > [0, oo) satisfying 

dH = (2.1) 

for all u; G {0, 1}*. Intuitively, o? is a strategy for betting on the successive bits of a sequence 
S G {0, 1}°°: The quantity d{w) is the amount of money that the gambler using this strategy 
has after \w\ bets if w Q S. Condition (2.1) says that the payoffs are fair. 

A martingale d succeeds on a language A C {0, 1}*, and we write A G S'°°[d], if 
lim sup^^ j^d{w) = oo. If t : N ^ N, then a martingale d is {exactly) t{n)- computable if 
its values are rational and there is an algorithm that computes each d{w) in t{\w\) time. A 
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martingale is p-computable if it is n'^-computable for some k eN, and it is Pj-computable 
if it is 2^^°^"'^ -computable for some A; G M. 

Definition 2.1. [22] Let X he a set of languages, and let i? be a language. 

(1) X has p-measure 0, and we write ^p(^) = 0, if there is a p-computable martingale 
d such that X C S'^ld]. The condition //p^(X) = is defined analogously. 

(2) X has measure in EXP, and we write | EXP) = 0, if /ip^ {X n EXP) = 0. 

(3) R is p-random if ^p({i?}) ^ 0, i.e., if there is no p-computable martingale that suc- 
ceeds on R. Similarly, R is t{n)-random if no t{n)- computable martingale succeeds 
on R. 

It is well known that these definitions impose a nontrivial measure structure on EXP 
[22]. For example, /x(EXP | EXP) 0. 

We use the following fact in our arguments. 

Lemma 2.2. [3, 18] The following five conditions are equivalent. 

(1) ^(NP I EXP) ^ 0. 

(2) Mp(NP) ^ 0. 

(3) /.p^(NP)^0. 

(4) There exists a p-random language R G NP. 

(5) For every k>2, there exists an 2'°s" -random language R G NP. 

Finally, we note that /x(P | EXP) = [22], so /x(NP | EXP) ^ implies P ^ NP. 

3. Inseparable Disjoint NP Pairs and the Measure of NP 

This section presents our main theorem, which says that, if NP does not have measure 
in EXP, then there are disjoint NP pairs that are P-inseparable. In fact, for each G N, 
there is a disjoint NP pair that is TIME(2" )-inseparable. 

It is convenient for our arguments to use a slight variant of the separability notion. 

Definition 3.1. Let {A,B) be a pair of (not necessarily disjoint) languages, and let C be 

a class of languages. 

(1) A language S C {0, 1}* almost separates {A, B) if there is a finite set D C {0, 1}* 
such that S separates {A — D,B — D). 

(2) We say that (^4, B) is C-almost separable if there is a language S £ C that almost 
separates {A,B). 

Observation 3.2. If a pair {A, B) is not C-almost separable, then {A — D,B — D) is 
C-inseparable for every finite set D. 

Before proving our main theorem, we sketch the intuitive idea of the proof. We want 
to construct a disjoint NP pair {A, B) that is P-inseparable. Our hypothesis, that NP does 
not have measure in EXP, implies that NP contains a language R that is p-random. Since 
we are being intuitive, we ignore the subtleties of p-randomness and regard i? as a sequence 
of independent, fair coin tosses (with the n^^ toss heads iff Sn G R) that just happens to be 
in NP. If we use these coins to randomly put strings in A or B but not both, we can count 
on the randomness to thwart any would-be separator in P. 
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The challenge here is that, if we are to deduce A,B(^ NP from R G NP, we must make 
the conditions "s„ € A" and G B" depend on the coin tosses in a monotone way; i.e., 
adding a string to R must not move a string out of A or out of B. 

This monotonicity restriction might at first seem to prevent us from ensuring that A 
and B are disjoint. However, this is not the case. Suppose that we decide membership of 
the n^^ string s„ in A and B in the following manner. We toss 21ogn independent coins. 
If the first logn tosses all come up heads, we put Sn in A. If the second logn tosses all 
come up heads, we put Sn in B. If our coin tosses are taken from R, which is in NP, then A 
and B will be in NP. Each string s„ will be in A with probability ^, in i? with probability 
^, and in An B with probability Since Yl'^=i n diverges and Yl'^=i converges, the 
first and second Borel-Cantelli lemmas tell us that A and B are infinite and Af^B \s finite. 
Since A{~^ B \s finite, we can subtract it from A and leaving two disjoint NP languages 
that are, by the randomness of the construction, P-inseparable. 

What prevents this intuitive argument from being a proof sketch is the fact that the 
language R is not truly random, but only p-random. The proof that Ap[ B is finite thus 
becomes problematic. There is a resource-bounded extension of the first Borel-Cantelli 
lemma [22] that works for p-random sequences, but this extension requires the relevant sum 
of probabilities to be p-convergent, i.e., to converge much more quickly than Yl^=i 

Fortunately, in this particular instance, we can achieve our objective without p-conver- 
gence or the (classical or resource-bounded) Borel-Cantelli lemmas. We do this by modifying 
the above construction. Instead of putting the n*'^' string into each language with probability 
^, we put each string x into each of A and B with probability 2~l^l so that x is'm. Af\B 
with probability 2~^l^l. By the Cauchy condensation test, the relevant series have the 
same convergence behavior as those in our intuitive argument, but we can now replace slow 
approximations of tails of Yl'^=i with fast and exact computations of geometric series. 

We now turn to the details. 

Construction 3.3. (1) Define the functions u^v : {0, 1}* — > {0, 1}* by the recursion 

u{X) = A, 

v{x) = nextl^l(«(x)), 
u(next(x) = nextl^l('u(x)). 

(2) For each x G {0, 1}*, define the intervals 

4 = [u{x),v{x)), Jx- = [v{x),u{next{x))). 

(3) For each R C {0, 1}*, define the languages 

A+{R) = {.T I /, C i?} , B+{R) = {x I J, C i?| , 
A{R) = A+{R) - B+{R), B{R) = B+{R) - A+{R). 

Note that each |4| = | J^l = Also, = Ja = (so A G A+{R) n B+{R)), and 

Iq < < ^1 < < -^00 < «^00 < -^01 < • • • ) 

with these intervals covering all of {0, 1}*. 

A routine witness argument gives the following. 

Observation 3.4. (1) If i? G NP, then A+{R), B+{R) G NP. 

(2) If i? G NP and \A+{R) n B+{R)\ < oo, then {A{R),B{R)) is a disjoint NP pair. 

We now prove two lemmas about Construction 3.3. 
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Lemma 3.5. Let A; G N. IfRQ {0, 1}* is 2(i°g")''+'- random, then {A+ (R) , B+ (R)) is not 
TIME(2"* )-a/mosi separable. 

Lemma 3.6. If R Q {0, 1}* is p-random, then \A+{R) n B+{R)\ < oo. 

We now have what we need to prove our main result. 
Theorem 3.7. (main theorem) If NP does not have measure in EXP, then, for every 

k 

k G Z"*", there is a disjoint NP pair that is TIME(2"' ) -inseparable, hence certainly P- 

inseparable. 

Proof. Assume that ;u(NP | EXP) ^ 0, and let A; € N. Then, by Lemma 2.2, there is 
a 2('°s"'^*^^-random language R G NP. By Lemma 3.5, the pair (A'^ (R) , (R)) is not 
TIME(2" )-almost separable. Since R is certainly p-random, Lemma 3.6 tells us that 
\A+{R) n B+{R)\ < C5C. It follows by Observation 3.4 that {A{R),B{R)) is a disjoint 
NP pair, and it follows by Observation 3.2 that {A{R),B{R)) is TIME(2'*'')-inseparable. ■ 



4. Genericity and Measure of Disjoint NP Pairs 

In this section we introduce the natural notions of resource-bounded measure and gener- 
icity for disjoint pairs and relate them to the existence of P-inseparable pairs in NP. We 
compare the different strength hypothesis on the measure and genericity of NP and disjNP 
establishing all the relations in Figure 1. 

Notation. Each disjoint pair {A, B) will be coded as an infinite sequence T G {—1, 0, 1}°° 
defined by 

' 1 if s„ G ^ 
T[n] = 1 -1 if .s„ e B 

[ if (^AUB 
We identify each disjoint pair with the corresponding sequence. 

Resource-bounded genericity for disjoint pairs is the natural extension of the concept 
introduced for languages by Ambos-Spies, Fleischhack and Huwig [1]. 

Definition 4.1. A condition C is a set C C {—1,0,1}*. A t(n)-condition is a condition 
C G DTIME(t(n)). A condition C is dense along a pair {A, B) if there are infinitely many 
n G N such that {A,B)[{)..n — l]i G C for some i G {—1,0,1}. A pair {A,B) meets a 
condition C if {A, B)[0..n — 1] G C for some n. A pair {A, B) is t{n)-generic if {A, B) meets 
every t(n)-condition that is dense along [A^B). 

We first prove that generic pairs are inseparable. 
Theorem 4.2. Every t{logn)-generic disjoint pair is TlME{t{n)) -inseparable. 

We can now relate genericity in disjNP and inseparable pairs as follows. 
Corollary 4.3. // disjNP contains a 2^^°^'^^'' -generic pair for every A; G N, then disjNP 

k 

contains a TIME(2"' )-inseparable pair for every A; G N. 

Resource-bounded measure on classes of disjoint pairs is the natural extension of the 
concept introduced for languages by Lutz [22], and is defined by using martingales on a 
three-symbol alphabet as follows. 



INSEPARABILITY AND STRONG HYPOTHESES FOR DISJOINT NP PAIRS 



401 



Definition 4.4. (1) A pair martingale is a function d : {—1,0, 1}* — [0, oo) such that 
for every w G {-1, 0, 1}* 

d{w) = \d{wO) + ^diwl) + ld{wi-l)). 

(2) A pair martingale d succeeds on a pair {A, B) if hmsup^_^(^ d{w) = oo. 

(3) A pair martingale d succeeds on a class of pairs X C {—1, 0, 1}°° if it succeeds on 

each {A, B) G X. 

Our intuitive rationale for the coefficients in part 1 of this definition is the following. 
We toss one fair coin to decide whether € A and another to decide whether s\^\ G B. 
If both coins come up heads, we toss a third coin to break the tie. The reader may feel 
that some other coefficients, such as 5,5,5 arc more natural here. Fortunately, a routine 
extension of the main theorem of [5] shows that the value of /u(disjNP | disjEXP) will be 
the same for any choice of three positive coefficients summing to 1. 

When restricting martingales to those computable within a certain resource bound, we 
obtain a resource-bounded measure that is useful within a complexity class. Here we are 
interested in the class of disjoint EXP pairs, disjEXP. 

Definition 4.5. (1) Let be the class of functions that can be computed in time 

2(logn)0(i) 

(2) A class of pairs X C {—1,0, 1}°° has Pj-measure if there is a martingale d G Pj 

that succeeds on X. 

(3) X C {—1,0, 1}°° has Pj-measure 1 if X^ has Pj-measure 0. 

(4) A class of pairs X C {-1, 0, 1}°° has measure in disjEXP, denoted iJ,{X \ disjEXP) = 
0, if X n disjEXP has P2 -measure 0. 

(5) X C {—1,0, 1}°° has measure 1 in disjEXP if X'^ has measure in disjEXP. 

It is easy to verify that Pj-measure is nontrivial on disjEXP (as proven for languages 
in [22]). 

In the following we consider the hypothesis that disJNP does not have measure in 
disjEXP (written //(disjNP | disjEXP) 7^ 0). We start by proving that this hypothesis is at 
least as strong as the well studied /i(NP | EXP) ^ hypothesis. 

Theorem 4.6. ////(disJNP | disjEXP) 7^ then //(NP | EXP) 7^ 0. 

We finish by relating measure and genericity for disjoint pairs. 

Theorem 4.7. // /i(disjNP | disjEXP) 7^ 0, then disjNP contains a 2(^°g") -generic pair 
for every k EN. 

5. Oracle Results 

All the techniques in this and related papers relativize, that is they hold when all 
machines involved have access to the same oracle A. In this section we give relativized 
worlds where the converses of most of the results in this paper, as expressed in Figure 1, do 
not hold. Since the implications trivially all hold in any relativized world where P = NP [4] , 
one cannot use relativizable techniques to settle these converses. 

We'll work our way from the bottom up of Figure 1. 
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//(disjNP I disjEXP) ^ 



Theorem 4.6 



//(NP I EXP) ^ 




Theorem 3.7 




Theorem 4.7 



(VA;)disjNP contains 
a 2''^°s"'^ —generic pair 

OoroUary 4.3 



P 7^ NP n coNP 



(V/c) disjNP contains 

a TIME(2'^')-inseparable 
pair 



Sr Grollmann & Selman [15] 

=^ disjNP contains < = p ^ uP 

P-inseparable pairs 



P ^ NP 



Figure 1: Relations among some strong hypotheses. 

Theorem 5.1 (Homer-Selman [17], Fortnow- Rogers [8]). There exists oracles A and B 
such that 

• P"^ 7^ NP"^ and disjNP^ does not contain Y*^ -inseparable pairs. 

• P^ = NP^ n coNP'^ = UP'^ and disjNP^ does contain -inseparable pairs. 

Theorem 5.2. There exists an oracle C such that P*^ ^ UP*^ but NP*^ is contained in 
TIME'^(n<^(i°s")). In paHicular this means that relative to C, disjNP contains V -inseparable 

k 

pairs but there is a k (and in fact any real k > 0) such that disjNP has no TIME(2"' )- 
inseparable pairs. 

Theorem 5.3. There exists a relativized world D, relative to which for all k, disjNP con- 

k 

tains a TIME(2"' )-inseparable pair but ;u(NP[EXP) = and disjNP does not contain a 
2^"^°^"^)^ -generic pair. 

Theorem 5.4. There exists an oracle E relative to which for all k, disjNP contains a 
2(iogn)^^g^g^-^ pair but /i( disjNP [disjEXP) = 0. 

Conjecture 5.5. There exists an oracle H relative to which //(NP[EXP) 7^ but 
//(disjNP[disjEXP) = 0. 
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Let K be a PSPACE-compete set, i? be a "random" oracle and let 

H = K®R = {{0,x) I xeK}[j{{l,y) \ y e R}. 

Kautz and Miltcrscn show in [20] that relative to H, /i(NP|EXP) 7^ 0. Kahn, Saks and 
Smyth [19] combined with unpublished work of Impagliazzo and Rudich show that relative 
to H there is a polynomial-time algorithm that solves languages in NP fl coNP on average 
for infinitely-many lengths which would imply /x(NP fl coNP|EXP) = relative to H. We 
conjecture that one can modify this proof to show /x(disjNP^|disjEXP^) = 0. 
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